Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Merge unify_projection and CF cache changes to master #609

Merged
merged 33 commits into from
Nov 26, 2024
Merged

Merge unify_projection and CF cache changes to master #609

merged 33 commits into from
Nov 26, 2024

Conversation

danscales
Copy link
Collaborator

Merge (to master) Daniel's unify_projection change (with typo fix) and
Solomon's clear cloudfront-cache for COGs. Need to actually run
the dist-alerts datapump in production.

@dmannarino
Add unify_projection option, partially hardcoded MVP impl.
6b12cab
@dmannarino
Whitespace breaks bash var assignments?
ba4a1a2
@dmannarino
Run unify projection step in parallel
a5a5c8e
@dmannarino
Fix expansion of CMD_ARGS
44540cb
@dmannarino
Fix count/src_count mistake; insert possibly unnecessary brackets
a8b3d34
@dmannarino
Echo commands for debugging; fix ref to wrong arg in helper
16a2cff
@dmannarino
Fix counting srcs
686c871
@dmannarino
Switch to GDAL2TilesJob for access to awscli (installed in that conta…
f8cafbd 
…iner image)
@dmannarino
Bump GDAL container version for gsutils
1b4dd60
@dmannarino
Fix unify script by pre-making dirs
92b7c96
@dmannarino
Fix only 1st src being used, I think
e311629
@dmannarino
Allow for AWS source URIs
8690d5c
@dmannarino
Removing time commands
6bbb9d0
@dmannarino
Change 'original' prefix to 'reprojected'
59e46d7
@dmannarino
Recursively pre-dl files
5460f38
@dmannarino
Fix gsutil command; fix aws dl command to be recursive
3455576
@dmannarino
Set unify proj job to parent of pixetl job
6e6838a
@dmannarino
Remove double parens
18fc7c8
@dmannarino
Remove ./ from paths
71a3c2a
@dmannarino
Replace tree (not in image) with find
d0c56d8
@dmannarino
Fix grabbing 5 args with xargs when should have grabbed 4
10b7765
@dmannarino
re-center TIFFs that cross the dateline
6634b8f
@dmannarino
Possibly fix running _tiff_crosses_dateline.sh
98f4816
@dmannarino
Replace bc with Python; hopefully fix gdalwarp arg complaints
e7614ae
@dmannarino
Fix prefix name (epsg:4326 -> epsg-4326) to be consistent
459d90d
@dmannarino
Improve docs in response to Dan's PR comments
c4b4a27
@dmannarino
Merge branch 'develop' into add_unify_projection
989c14f
@dmannarino
Merge pull request #601 from wri/add_unify_projection
4dc4186 
Add option to pre-warp to a common projection
@dmannarino
Fix copy/paste error
036eab5
@dmannarino
Merge pull request #604 from wri/fix_xing_dateline
e446480 
Fix copy/paste error
solomon-negusse and others added 3 commits November 11, 2024 14:21
@solomon-negusse
clear cloudfront caches
a009eab
@solomon-negusse
Merge pull request #605 from wri/clear-cog-tile-caches
f4f0929 
clear cloudfront caches
@danscales
Merge unify_projection and CF cache changes to master
9f57856 
Merge Daniel's unify_projection change (with type fix) and
Solomon's clear cloudfront cache for COGs.
@danscales danscales merged commit 0dbe8b6 into master Nov 26, 2024
2 checks passed
@danscales danscales deleted the merge_unify_proj branch November 26, 2024 16:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@solomon-negusse solomon-negusse solomon-negusse approved these changes

@dmannarino dmannarino Awaiting requested review from dmannarino

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@danscales @solomon-negusse @dmannarino